Learning an Intersection of k Halfspaces over a Uniform Distribution
نویسندگان
چکیده
We present a polynomial-time algorithm to learn an intersection of a constant number of halfspaces in n dimensions, over the uniform distribution on an n-dimensional ball. The algorithm we present in fact can learn an intersection of an arbitrary (polynomial) number of halfspaces over this distribution, if the subspace spanned by the normal vectors to the bounding hyper-planes has constant dimension. This generalizes previous results for this distribution, in particular a result of Baum 1] who showed how to learn an intersection of 2 halfspaces deened by hyperplanes that pass through the origin (his results in fact held for a variety of symmetric distributions). Our algorithm uses estimates of second moments to nd vectors in a low-dimensional \relevant subspace." We believe that the algorithmic techniques studied here may be useful in other geometric learning applications.
منابع مشابه
Learning an Intersection of a Constant Number of Halfspaces over a Uniform Distribution
We present a polynomial time algorithm to learn an intersection of a constant number of halfspaces in n dimensions over the uniform distribution on an n dimensional ball The al gorithm we present in fact can learn an intersection of an arbitrary polynomial number of halfspaces over this distribution if the subspace spanned by the normal vectors to the bounding hyperplanes has constant dimension...
متن کاملLearning Functions of Halfspaces using Prefix Covers
We present a simple query-algorithm for learning arbitrary functions of k halfspaces under any product distribution on the Boolean hypercube. Our algorithms learn any function of k halfspaces to within accuracy ε in time O((nk/ε)) under any product distribution on {0, 1} using read-once branching programs as a hypothesis.. This gives the first poly(n, 1/ε) algorithm for learning even the inters...
متن کاملImproved Lower Bounds for Learning Intersections of Halfspaces
We prove new lower bounds for learning intersections of halfspaces, one of the most important concept classes in computational learning theory. Our main result is that any statistical-query algorithm for learning the intersection of √ n halfspaces in n dimensions must make 2 √ n) queries. This is the first non-trivial lower bound on the statistical query dimension for this concept class (the pr...
متن کاملLearning Intersections and Thresholds of Halfspaces
We give the first polynomial time algorithm to learn any function of a constant number of halfspaces under the uniform distribution on the Boolean hypercube to within any constant error parameter. We also give the first quasipolynomial time algorithm for learning any Boolean function of a polylog number of polynomial-weight halfspaces under any distribution on the Boolean hypercube. As special ...
متن کاملOn Agnostic Learning of Parities, Monomials, and Halfspaces
We study the learnability of several fundamental concept classes in the agnostic learning framework of Haussler [Hau92] and Kearns et al. [KSS94]. We show that under the uniform distribution, agnostically learning parities reduces to learning parities with random classification noise, commonly referred to as the noisy parity problem. Together with the parity learning algorithm of Blum et al. [B...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1993